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Active Brownian motion is the complex motion of active Brownian particles. They are "active" 
in the sense that they can transform their internal energy into energy of motion and thus create 
complex motion patterns. Theories of active Brownian motion so far imposed couplings between 
the internal energy and the kinetic energy of the system. We investigate how this idea can be 
naturally taken further to include also couplings to the potential energy, which finally leads to a 
general theory of canonical dissipative systems. Explicit analytical and numerical studies are done 
for the motion of one particle in harmonic external potentials. Apart from stationary solutions, we 
study non-equilibrium dynamics and show the existence of various bifurcation phenomena. 



I. PRELIMINARIES 

The theory of Brownian motion in its formulation due to Langevin 1] assumes that particles are subject to stochastic 
influences and external forces, the latter making them move according to the potential U{q), which models their 
environmental landscape. Stochastic equations of motion are 

dqi dpi dU 

including a friction term with friction constant 70 > 0, the force of the external potential —diU and the random 
force rji, which has infinite variance per definition. Particles are considered to be without an inner structure, just 
driven by the external potential and the noise, without any capability of changing their dynamics by themselves. If 
studying the complex motion e.g. of bacteria or even higher developed organisms, this simple assumption of particles 
reacting to a prescribed potential landscape cannot explain the widely observed emergent phenomena arising in such 
systems. A number of models were proposed, including some kind of 'self driven motion' of particles, which should 
account for the lack of complex behavior dynamics. Apart from just postulating such additional effects, the theory 
of active Brownian particles 0, 0, 0, 0] explains the origin of this 'self-motion' by imposing an additional internal 
degree of freedom, called 'internal energy' e. This energy can be increased by taking up external energy ('food') from 
the environment and be transformed into kinetic energy of the particle, i.e. the particle is 'active' in the sense that 
it is able to convert its internal energy into energy of motion. This model has served to describe animal mobility in 
general Q and was able to make quantitative statements about emergent self-organized properties in the collective 
behavior of many particle systems, e.g. swarms 0, BQ- 

After reviewing some fundamental aspects of the original theory, we propose a canonical version of active Brownian 
motion by allowing to convert internal energy into the full mechanical energy of the particle. In case of stationary 
internal energies our generalized theory defines active Brownian motion as a canonical dissipative system also with 
interactions, which was not possible in former models. Interacting active Brownian particles were studied intensively 
0) B 0) B S 0|i recent contributions included dissipative Toda- and Morse-systems [H, [13, 111]- In our formalism, 
however, we are able to study interacting active Brownian motion as a canonical dissipative system. 

The original formulations of active Brownian motion rarely discuss nonequilibrium dynamics. In most applications, 
only stationary solutions are present, which implies constant internal energies for all times. We will show how active 
Brownian motion in its fully coupled form contains rich nonequilibrium structures, too. 



II. ORIGINAL THEORY: COUPLING OF e TO THE KINETIC ENERGY 

The main idea of active Brownian motion is to ascribe an additional, so called 'internal' energy e [H] to Brownian 
particles. Stochastic dynamics for the motion of an active particle in d dimensions with degrees of freedom qi and 
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associated momenta pi, where i = 1, . . . , d and q = (qi), p = (pi) read 

(2) 



dqi dH 
dt dpi 



dpi dH I .dH 
de p2 

- = c,-c,e- C3e- (4) 

2 

with H{q^p) — ^ -\- U{q) and g{e) = 70 — (^26. Noise correlations are 

(77.(0) -0 , {rn{tH{t))^26,,d{t-t). (5) 

All constants Ci, as well as 70, (^2 are assumed to be positive. Calculating the total time derivative of the Hamiltonian 
in the deterministic case yields 

dH fdHY _ 2 , 2 



which allows us to interpret the implications of internal energy dynamics: The first term models the mechanical energy 
loss by friction due to the surrounding media, whereas the second term shows the possibility of an energy increase 
via the coupling of kinetic energy to the internal energy. If the internal energy becomes stationary after some time 
(^ = 0), it can be expressed as a function of the kinetic energy: 

- (7) 
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C2 + C3^ 

which implies 

— = -— -7(p)— +77- (8) 
dt dqi dpi 

where 7(p) =70 '^^'^^ a ■ The equation above defines a model of Brownian motion in media of nonlinear friction. 

Active Brownian particles with stationary internal energies therefore move like in a medium with nonlinear friction 

function "f{p). Relaxation of the internal energy to a stationary value therefore results in changing the original friction 

of the medium to an effective friction. The following section will show that equilibrium internal energies will have 

2 

completely different effects in the case when e is coupled to the potential energy U (q) , instead of coupling it to ^ , as 
is usually done. Setting ^ = will then result in changing the original potential to an effective one. 

III. COUPLING OF e TO THE POTENTIAL ENERGY 

Active Brownian motion in its original formulation imposes a coupling of the internal to the kinetic energy, given 

2 

by equation (j4]), in which e is multiplied by The most natural and simplest way to extend this balance equation 
to the case of potential couplings would be to multiply e with U{q). Furthermore, in equation ([3]), it should appear 
the product between the internal energy and the q-gradient of H (and not the p-gradient as in the original case). 
Especially when considering many particle systems like swarms, exchanges between internal and potential energies 
seem physically intriguing: Swarm particles generate their interaction potentials mutually due to exchange of internal 
energy; the internal energy of one particle has effects on its interaction with all the other particles. In the present 
paper we study the dynamics of a single particle only, but we already introduce its generalized couplings for the 
internal energy. 

We have already given stochastic differential equations for this set-up in configuration space Stochastic 
dynamics in phase space equivalently read: 

dq^^dH 
dt dpi 
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dp, dH dH 

^''^ 

de 

— ^ d - C2e - czeU (11) 

2 

with H{q,p) ~ ^ + U{q) and /(e) = 1 — die. The system is constructed in complete analogy to the original theory 

2 

of active Brownian motion, but with interchanging the role of p and q, resp. ^ and U{q). The evolution equation 
for the Hamiltonian is calculated in the same way as in Sec. [TTl which leads to 

ij = -7op'+die(p- Vf/). (12) 

Discussions about the interpretation of such conservation laws can be found in the standard textbook [F] . 

One remarkable feature is the emergence of effective potentials in the time region of stationary internal energy, i.e. 
^ = 0; hence 

C2 + csfy [q] 



and thus 



dqi dH 
dt dpi 



(14) 



— = -70— +r/, (15) 

dt dqi dpi 

which are formally the well known equations for the motion of a Brownian particle in media of linear friction, but 
with an effective Hamiltonian 

H = ^ + U{q) , [7(g) = [/(g)-^ln(c2 + C3C/(g)). (16) 
2 C3 

Its time evolution in the deterministic case is given by 

dH o . 

Couplings of e to the potential energy therefore manifest themselves by changing the original potential to an effective 
one. Stationary internal energies in classical active Brownian motion describe systems of a particle moving with 
an effective nonlinear friction j{p), whereas in the case of internal energy coupled to U{q), the arising effect lies 
in changing the original potential to an effective one U{q). The crucial role of this effective potential can be seen 
by numerical investigations of equations ([5|)- PT|l for specific forms of U{q): Under the influence of harmonic forces 
U = aq^ , the motion of one particle in two dimensions is given by 

dqi dq2 , , 
-dt^P' ' -dt^P' 

'7oPi " 2agi + 2di eagi + s2 ^1 (19) 

^7oP2 - 2ag2 + 2di eag2 + s5 ^2 (20) 



dpi 
dt 

dp2 
dt 



de 

— = ci - C2e - C3 ea (gi^ + (72^) (21) 
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FIG. 1; Two dimensional motion of an active particle under the influence of harmonic forces in the gi,q2-plane, subject to 
equations (f9)l- (|lip with all parameters chosen to be equal to one except di = 5 and S2 = 0.3. The radius of the circle can be 
calculated from equation p3)) : ro = 2. Initial conditions are qi{0) = = 52(0), pi(0) = = P2(0), e(0) — 0. 



where a noise strength factor s was introduced via the substitution 77 — 52^. (For a detailed discussion of equilibrium 
solutions and its bifurcations, see Section 5.) Figure [1] shows the simulated behavior of a particle subject to the 
equations given above. 

Out of its initial conditions, the particle drops onto a circle and then diffuses in no preferred direction, until the 
whole ring area is filled with trajectories. This random motion on a ring can be explained by referring to the structure 
of the effective potential, which for the harmonic example reads 



in terms of the radial coordinate r 



U{r) 



dici 

C3 



In (c2 + csar^) 



92^) ^ ■ The minima of U{r) are found to be at all radial distances 



(22) 



'"0 = 



ac3 



(23) 



which is exactly the radius of the circle seen in Figure [T] In the case of no coupling to an internal energy (di = 0) , 
the particle would directly fall into the minimum of the external potential (which is at r = 0), and no diffusion in 
any direction would be present. Positive values of ro can be realized for critical values of the coupling parameter di, 
namely if di > Active Brownian particles with a coupling of e to the potential energy feel a different landscape 
than the prescribed one, i.e. an effective environment, which is then searched for minimum areas. The internal energy 
effect in our present example results in trapping the particle not at the origin, but on a circle of a given radius r = tq. 
This stationary state of noise-induced wandering in the valley of minima is immediately present after the internal 
energy has finally relaxed to its constant value gq, given by equation (jl3p . In the minimum region r = rp, so the 
stationary value of the internal energy can be calculated directly: 



eo 



ci 



C2 + czaro^ 



1 



(24) 



Figure m shows the relaxation of e to the stationary value cq- After initial oscillations it equilibrates to a constant 
value (which is then slightly disturbed by the noise influences). 
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FIG. 2: Internal energy evolution in time corresponding to the parameter setup given in Figure [T] The stationary value of e 
can be calculated from equation (|24|) : eo = 1/5. 



Another remarkable feature of coupling the internal energy to the potential is that equilibrium distributions can be 
calculated exactly. The standard form of stochastic differential equations p4l) & ([15]) has the following well-known 
stationary solution of the corresponding Fokker Planck equation: 

p{q,p)^e-"^'^-P\ (25) 

which reduces to p{q) ~ e^'^^'?-' for the distribution in configuration space, after performing the Gaussian momentum 
integral. This is an exact equilibrium solution of our nonlinear stochastic process. Former models of active Brownian 
motion had to rely on specific approximation methods, when studying equilibrium solutions of the corresponding 
Fokker Planck equation |lll |. 



IV. CANONICAL ACTIVE BROWNIAN MOTION: COUPLING OF e TO THE TOTAL MECHANICAL 

ENERGY 

Combining the so far separately imposed couplings to the kinetic, resp. the potential energy, stochastic dynamics 
are in full generality: 

dq^ dH 

de 

— = ci - C2e - c^eH (28) 
at 

2 

with H{q,p) = ^ + U{q) and /(e) = 1 — die , g{e)= 70 — ^26. Recently another generalized model for internal 
energy dynamics was introduced by Zhang et. al. [l6[. Whereas in their paper the coupling of internal energy to 
position and velocity is generated via an arbitrary function of q and p, our coupling mechanism is motivated from 
the idea of exchange between internal and the full mechanical energy. The time differential of the Hamiltonian in the 
deterministic case reads 

dH , JOhV , dHdH 2 ,2 , dU 

If the internal energy equilibrates after some time, its stationary value would be 

e{H) = 2' rr ^ (30) 

C2 + C3H 
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so that dynamics reduce to 

dqi dH 



dt dp, ^^^^ 



with the two dissipation functions 



nH) = l-^^ , G(i/)=7o-^^. (33) 
Stochastic equations for active Brownian motion now truly define a canonical system, in the sense that all parts of the 

2 

dynamics are completely given by the Hamiltonian function, which was not the case for separate couplings to ^ or 

U{q). Only when we consider free particles {H = ^^), so that in equation ([5]) 7(p^) — l{H), active Brownian motion 
in its original sense is a canonical system. When coupling the internal energy to the Hamiltonian, also the general 
case of active Brownian particles with interactions (i.e. with a potential) represents a canonical dissipative system. 
The method of coupling e to the full mechanical energy leads to a novel type of canonical dissipative system, which 
has a more complex dissipative behavior and is more general than those ones which currently exist in the literature 

V. BIFURCATIONS OF EQUILIBRIA 

In this section, we investigate equilibrium solutions of canonical active Brownian motion and its possible bifurcation 
scenarios. Bifurcation theory studies the qualitative change of solutions for a dynamical system when parameters are 
varied. Static bifurcations are present, e.g., when for some critical parameter values, two equilibrium points become 
stable while another one loses its stability. Apart from dealing only with stationary solutions, dynamic bifurcations 
describe how equilibrium points can bifurcate into nonequilibrium orbits, e.g. limit cycles. We will encounter both of 
these bifurcation scenarios in canonical active Brownian motion. Special attention is given to nonequilibrium solutions, 
i.e. situations in which ^ 7^ 0. Bifurcations of active Brownian motion for some special case of generalized internal 
energy dynamics were studied also in p6|. However, no bifurcation analysis for velocity and space dependent internal 
energy equations were given, nor was considered the case of an external harmonic potential. We will investigate the 
non-equilibrium behavior of active Brownian motion, when both kinetic and potential energy coupling is present. 

For the following explicit calculations, we assume the harmonic external potential U{q) = ^q^ . Stochastic differential 
equations then read 

~^=Pi ' = -i^-die)q,-{-fQ-d2e)p, + r]i (34) 

de p2 q2 

— = Cl - C2e - caey - C4ey, (35) 
where we have separated the couplings of e to the kinetic and the potential energy for later analysis of special cases. 

A. One Dimension 

Equilibria in one dimension for the deterministic case are 

qo = 0=po, Co = — (el) 

C2 

r2(dici-c2)\'/' ^1 , 

qo = ±[ 1 , Po = 0, eo = ^ (e2) 
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FIG. 3: Trajectory to equilibrium (|eT|l . parameters satisfying the corresponding stability conditions: 70 — 1, ci — 1, C2 = 2, 
C3 = 2, Ci — 2, di = 1, d2 = 1. (The internal energy is plotted with a factor of 2.) 



Stability conditions of these points are obtained by linearizing the system. In equations (p4l) & (|35p. we make the 
shift q ^ q + qo, p p + po, e — > e + eo, neglecting any terms of order higher than one. Then dynamics are given only 
by the Jacobian matrix, whose eigenvalues can be studied for each of the three equilibria separately. For equilibrium 
(|eT|) , the eigenvalues of the Jacobian are 

The real parts of all A^'s are negative if 70C2 > d2Ci and C2 > dici. Hence, equilibrium (jel[) remains stable as long as 
these two conditions are fulfilled. Figure [3] shows a trajectory in phase space {q,p,e) approaching equilibrium ([eT|) . 

The corresponding eigenvalues for equilibria (|e2p are not accessible so easily, so we follow the Routh-Hurwitz 
theorem 14], which allows one to calculate stability regions by analyzing only the characteristic equation of the 
Jacobian, without any need for solving it. Application of this scheme for equilibria (|e2p results in the conditions 
7odi > d2, C2 < diCi and (70^1 — d2){c1di + ci(7odi — ^2)) > 2di{cidi — C2) for both of them. 

Two types of bifurcations can be seen, a static and a dynamic one. First we observe a Pitchfork-bifurcation of 
equilibrium (Icip into the two other ones at C2 = diCi: As long as C2 > diCi is fulfilled, equilibrium (jeip is stable, while 
equilibria (je2p do not exist. For parameter regions where C2 < diCi, equilibria (je2[) are stable, while equilibrium (|eip 
becomes unstable. Apart from this static bifurcation we observe a dynamic bifurcation, namely a Hopf-bifurcation, 
at 70C2 = d2Ci: Suppose we fix the condition C2 > c?ici, by looking at the eigenvalues we see the appearance 
of a purely imaginary pair of eigenvalues A2,3 = ±iuj at the critical point 70C2 = c?2Ci (while ReAi ^ 0). This is the 
general condition for the existence of a Hopf-bifurcation, which describes equilibria bifurcating into periodic solutions 
[l5'|. Equilibrium (jeip bifurcates into limit cycles at the Hopf bifurcation point 70C2 = d2Ci. One example of these 
limit cycles is shown in figure [D 



B. Arbitrary Dimensions 

A similar study can be made for arbitrary dimensions n. First we reduce the (2?! -I- l)-dimensional system p4p & 

psp to four dimensions by transforming to the variables K = U = ^ and S = qp. Evolution equations in its 
deterministic form therefore transform to 

^ = -2(7o-d2e)X-(l-die)5 , (37) 





FIG. 4: Limit cycle appearing after the Hopf-bifurcation point. Parameter values are: 70 = 1, ci = 1, C2 = 2, C3 = 2 = C4, 
di = 1, d2 — 5. Initial conditions were chosen to be q{0) — 0, p{0) = —1 and e(0) = 0. (The internal energy is plotted with a 
factor of 10.) 
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— = 2X - (70 - d2e)S - 2(1 - die)U, 
at 



de 

— ~ Cl ~ €26 — c^eK — CicU. 
at 



The following are the three possible equilibrium points: 



Sa = Ko = Uo = 0, Co = — 

C2 



Q a TT ^1^1 - '^2 1 

oq = Kq = U, Uo = , eo = — 

C4 di 



(38) 
(39) 

(El) 
(E2) 



^0 = 0, Ko= l- 



d2 



Un 



Un = 



d2Ci - C270 



70 C3 



{ 1 _ dryo\ 



■ 70C4 



To 
d2' 



(E3) 



Before addressing bifurcation theory, we shortly comment on how these equilibrium points of canonical active Brownian 
motion contain equilibria of the separately coupled versions. The equilibrium solution of original active Brownian 
motion (coupling of e only to the kinetic energy) for a harmonic potential is identical to the equilibrium point (jE3p , 
if di = and C4 = 0. The case of internal energy coupling only to the potential, studied in Section [IIIl is identical to 
equilibrium (|E3p . also for nonvanishing d2 and C3. Active Brownian motion in its fully coupled form therefore shares 
the same equilibrium solution with the system when coupled only to the potential. Therefore the same trajectories 
as already shown in figure [T] can be seen. 

We now repeat our linearization procedure concerning stability properties and bifurcations. Eigenvalues of the 
Jacobian associated with equilibrium (jEip can be calculated straightforwardly: 



Ai 



-C2 



A. 



cid2 - C270 



C2 



(40) 
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FIG. 5: Trajectory in 4-dimensional phase space to equilibrium (IE3|) for the following choice of parameters: 70 = 11, ci = 4, 
C2 = 0.01, C3 = 129, C4 = 31, di = 0.01, d2 = 48 and initial conditions ^(O) = 0.1, U{0) = 0.1, K{0) = 0.1, e(0) = 0.2. (The 
kinetic energy K is plotted with a factor of 3.) 



^3,4 



Cid2 - C270 



± 



C2 



70 



C2 



C2 



(41) 



The real parts are negative if the conditions 70C2 > c?2Ci and C2 > c?ici are fulfiUed (these are the same conditions 
as for equihbrium (jcip in one dimension). The stabihty analysis for equilibrium (|E2[) can be carried out via the 
Routh-Hurwitz theorem and it leads to the same conditions as for equilibrium (|e2p in one dimension. Equilibrium 
()E3|) is hard to analyze even with the Routh-Hurwitz procedure, so that we have no information about stability 
regions for this third stationary solution at all. Nonetheless we are able to find parameter values by hand which lead 
to trajectories approaching it slowly, as is shown in Figure [51 Concerning the bifurcation behavior of our system, we 
observe two collisions of equilibria at critical parameter values of ^2 (which we choose as our bifurcation parameter 
in the following). 

Such collisions are usually associated with Fold-bifurcations. Its general property is the existence of a simple zero 
eigenvalue of the Jacobian. This happens for equilibrium (|Eip when d2 — !^22hL^ go that A2 vanishes. At the Fold- 



bifurcation point d; 



d2 < 



_ c|2o^ equilibrium (|E1[) becomes identical with equilibrium (|E3p 
equilibrium (|Eip is stable, while (|E3|) does not exist, since the potential U = ^q^ has to be positive. 

^^222. equilibrium (jEl[) is unstable, and (jESp is observed to be stable (see Figure [S] for one 



Before the bifurcation, when 
After 



ci 



the Fold-point, when d2 > 
example) . 

Another Fold-bifurcation is present at ^2 = jodi, which is a bifurcation of equilibrium (jE2p . Although three of its 
eigenvalues are not accessible in a treatable way, one of them is in a simple form, namely A = ^("^^ w'^^"^"'* ■ It vanishes 
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FIG. 6: Limit cycle in the phase space of variables {K, U, S, e) and its corresponding quasi-periodic motion in configuration 
space for n = 2 after the transient phase. Parameter values are 70 = 1, ci — 1, C2 = 2, C3 = 4, C4 = 4, di = 49, d2 = 50 and 
initial conditions S{0) = 0, 17(0) — 0, K{0) — 1, e(0) — 0. Corresponding initial conditions in {qi,pi,e): gi(0) = = 92(0), 
pi(0) — —1 — P2{0), e(0) = 0. (The kinetic energy K is plotted with a factor of 3.) 

for d2 = 7o<ii and we see the collision of equilibrium (|E2p with (jE3|) at this point. Before this critical value, when 
^2 < 70*^1: equilibrium (|E2p is stable, while (|E3p does not exist, since the kinetic energy K — ^p^ has to be positive. 
After the bifurcation point, when d2 > 70^1, equilibrium (|E2[) is unstable, while (|E3p can be observed to be stable 
(see again Figure [5]). 

Apart from these two collisions of equilibria, a Fold-Hopf bifurcation is present. Remember that in one dimension 
we observed a Hopf bifurcation at some critical point in parameter space. In arbitrary dimensions, if the condition 
C2 > diCi is fulfilled, the eigenvalues A3^4 of equilibrium (lEip become a purely conjugate complex pair A3_4 = zLiu) at 
d2 = -7^ and A2 vanishes exactly. This zero-pair constellation at some critical point in parameter space is the general 
condition for a Fold-Hopf-bifurcation. To this type of bifurcation are associated various non-equilibrium dynamics, 
ranging from motions on tori to heteroclinic orbits [lB| • We do not want to address the analysis of this Fold-Hopf- 
bifurcation here, instead focusing on the interesting case, when stable limit cycles are present in our 4-dimensional 
system. Figure IH] shows a limit cycle in phase space (K, U, S, e). This periodic motion corresponds to a quasi-periodic 
motion in configuration space, as is shown for n = 2. Adding noise to our system doesn't change the qualitative 
behavior, only the direction of movement can change at some instances. 

Concluding this analysis of non-equilibrium behavior, we want to emphasize the various possibilities that arise from 
studying parameter regions where e is not constant, but heavily oscillating. Far away from stationary solutions, our 
system shows to have quasi-periodic dynamics. 

VI. SYNOPSIS AND OUTLOOK 

We have formulated a generalized version of active Brownian motion in the sense that we allow not only couplings 
of the internal energy to the kinetic energy, but also to the potential energy and more generally to the Hamiltonian. 
The latter case gives rise to a canonical dissipative system. Analysis of stationary points and its possible bifurcations 
into non-equilibrium solutions reveals a rich dynamical structure in parameter regions far away from equilibrium. 
Explicit numerical studies of all bifurcation scenarios will be left to future computer art; nevertheless we were able to 
find interesting quasi-periodic dynamics by hand. The various non-equilibrium phenomena may be relevant in future 
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applications to real systems, which do not rely on the assumption of stationary internal energies. Moreover, many 
particle systems with mutual interactions can be studied within the scheme of canonical active Brownian motion. The 
self-organizing properties e.g. of swarms will be of special interest for upcoming papers, when applying our model for 
a system composed of many particles. 
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